IN THE CLAIMS 

Please amend Claims 1-7, 10, 11, 13, and 16-19 as follows: 

1. (Currently Amended) An information processing device for aiding control operations 
relating to controlling the position and orientation of a virtual object positioned in 
three-dimensional space, said device comprising: 

image-taking means for taking images in real space in order to display the virtual 
object in a superimposed manner on real space; 

synthesizing superimposing means for superimposing synthesizing z the virtual object 
with the taken image; 

ope r ating m e ans for controlling the position and orientation of the virtual object; and 

inputting means for obtaining three-dimensional position information of a pluralitv of 
positions inputted bv a user in real space: 

aiding setting means for obtaining a tlii - cc-dimcnsional position of re al spac e from 
external instructions, and obtaining setting a constraining shape based on the obtained three- 
dimensional position information for aiding in cont r ol operations for th e position and orientation 
of the virtual object ; and 

operating means for performing an operation controlling the position and the 
orientation of the virtual object based on the constraining shape in accordance with the user's 
instructions wh e rein the p o sition and orientation o f the virtual object ai - c conti - oUed bv 
instructions from said operating means, bas e d on constraint conditions based on the const r aining 
shape obtained by said aiding means . 
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2. (Currently Amended) An information processing device according to Claim 1, wherein 
the constraining shape is a plane and the apexes thereof are at positions inputted by the user or 
the constraining shape is a plane passing through the positions inputted bv the user shape in 
which a tlircc-dimcnsional position in r eal space obtain e d by external instmctions is configui - cd 
of an apex or a component plane . 

3. (Currently Amended) An information processing device according to Claim 1, 
wherein said operating means performs at least one of the following operations in performing an 
operation controlling the following control ope r ations of the position and orientation of the 
virtual object can be made using said operating means : 

a translation operation for causing translational movement of the virtual object based 
on t r anslating transfomiation following the constraining shape; and 

a rotation operation for rotating the virtual object transfomiation on an axis which is a 
normal vector at a plane where the constraining shape and the virtual object come into contact. 

4. (Currently Amended) An information processing device according to Claim 1, 
wherein said operating means performs the operation controlling the position and the orientation 
of the virtual object in real time in accordance with the user's instructions the virtual object is 
subjected to tlii ' cc-dimcnsional t r ansfomiation by cont r ol o perations o f said o perating means, 
such that the position of said operating means on a two-dimensional screen and the position of 
th e virtual o bj e c t o n a two-dim e nsi o nal screen are synchr o niz e d . 
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5. (Currently Amended) An information processing method for aiding control operations 
relating to controlling the position and orientation of a virtual object positioned in three- 
dimensional space, said method comprising: 

an image taking step of taking images in real space a m e asurement step obtaining external 
pai ' amctcrs indicating the position and orientation of image-taking means in order to fixedly 
display the virtual object in a superimposed manner on in real space; 

a superimposing step of superimposing the virtual object with the taken image: 

an inputting step of obtaining three dimensional position information of a plurality of 
positions inputted bv a user in real space: 

an operating step for controlling the position and orientation of tlic virtual object; 

a setting an aiding step of setting f o r adding const r aints to tlie contr o l operati o ns o f an 
ope r ating m e ans so as to aid tlie control operations on tlic viitual object; an input step for 
inputting a constraining shape based on the obtained three dimensional position information tcrbc 
a r efe r ence for g e nerating the const r aints ; and 

an operating a synthesizing step for performing an operation controlling the position and 
the orientation synthesizing p ictu r es of r eal space obtained bv image-taking m e ans, and pictur e s 
of the virtual object based on the constraining shape in accordance with the user's instructions 
estimated from th e position and orientation of the image-taking means; whe r ein the position and 
o rientati o n of the virtual object in said operating step is transf o mied in said aiding step witli tlic 
const r aining shape as a refe re nc e , the r eby aiding control operations . 
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6. (Currently Amended) An information processing method according to Claim 5, 
wherein said setting step sets a constraining shape comprising a plane the apexes thereof being at 
positions inputted bv the user in said inputting step or sets a constraining shape comprising a 
plane passing through the positions inputted by the user in said inputting step wherein said input 
st e p obtains tlii ' cc-dim c nsional position in real space from external instructions . 

7. (Currently Amended) An information processing method according to Claim 6, 
wherein said operating step comprises the steps of: 

causing translational movement of translating the virtual object based on the 
constraining shape; and 

rotating the virtual object on an axis which is a normal vector at a plane where the 
constraining shape and the virtual object come into contact wherein a virtual imag e indicating 
the input virtual shape is synthesized with an image of the real space and pictur e s of the virtual 
object. 

8. (Original) A computer program, wherein the information processing method 
according to Claim 5 is executed by a computer device. 

9. (Original) A computer-readable recording medium, storing the computer program 
according to Claim 8. 
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10. (Currently Amended) An information processing method for controlling changing 
the position and orientation of a virtual object in compounded real mixed reality space obtained 
by combining synthesizing pictures of a real image spac e and a virtual image object , said method 
comprising the steps of : 

a step fo r obtaining a constraining shape sciTing as constraint conditions, from a 
plurality of positions in real space designated instnictcd by a user using an operating unit capable 
of obtaining three-dimensional positional information; 

a step for changing the position and orientation of the virtual object according to 
instructions from the user, with based on the obtained constraining shape as constraint 
conditions; and 

a step f o r synthesizing combining an image of tiie virtual object generated according to 
the changed position and orientation, and the with pictu re s of real image s p ac e. 

1 1 . (Currently Amended) An information processing method according to Claim 10, 
further comprising the step of combining wherein a virtual image indicating the constraining 
shape input virtual shape is synthesiz e d with the pictures of real image spac e. 

12. (Original) An information processing method according to Claim 10, wherein the 
constraining shape is a plane. 



-8- 



13. (Currently Amended) An information processing method according to Claim 10, 
wherein said changing step changing chang e of the position and orientation of the virtual object 
is carried out by changing the position and orientation of the operating unit. 

14. (Original) A computer program, wherein the information processing method 
according to Claim 10 is executed by a computer device. 

15. (Original) A computer-readable recording medium, storing the computer program 
according to Claim 14. 

16. (Currently Amended) An information processing device for aiding control 
operations relating to controlling the position and orientation of a virtual object positioned in 
three-dimensional space, said device comprising: 

an image-taking unit configured to take for taking images in real space in order to display 
the virtual object in a superimposed manner on real space; 

a superimposing synthesizing unit configured to superimpose for syntliesizing a the 
virtual object with the taken image; 

an inputting unit configured to obtain three-dimensional position information of a 
pluralitv of positions inputted bv a user in real space: 

a setting unit configured to set a constraining shape based on the obtained three- 
dimensional position information : and 



an operating unit configured to control for controlling the position and orientation of the 
virtual object based on the constraining shape in accordance with the user's instructions and 

an input unit for obtaining a tlircc-dimcnsional position of real space from external 
inst r uctions, and o btaining a c o nstraining shape f o r aiding in c o ntrolling the positi o n and 
or ientati o n o f tlic virtual object; 

wherein the position and orientation of tlic virtual object arc controll e d by instructions 
fi -o m said o perating unit, based o n c o nstraint conditions based o n the constraining shape obtained 
by said input unit . 

17. (Currently Amended) An information processing device according to Claim 16, 
wherein the constraining shape is a plane and the apexes thereof are at positions inputted bv the 
user or the constraining shape is a plane passing through the positions inputted bv the user 
shape in which a tlircc-dimcnsional position in real space obtained by external instmctions is 
c o nfigured of an apex or a component p lan e. 

18. (Currently Amended) An information processing device according to Claim 16, 
wherein said operating unit performs at least one of the following operations in performing an 
operation controlling the following contiX ) l operations of the position and orientation of the 
virtual object can be made using said operating imit : 

a translation operation for causing translational movement of the virtual object based on 
transfomiation following the constraining shape; and 
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a rotation operation for rotating the virtual object transformation on an axis which is a 
normal vector at a plane where the constraining shape and the virtual object come into contact. 

19. (Currently Amended) An information processing device according to Claim 16 
wherein said operating unit performs the operation controlling the position and the orientation of 
the virtual object in real time in accordance with the user's instructions the virtual ob j ect is 
subjected to tlii - ce-dim c nsional transformation by cont r ol operations of said operating unit, such 
that th e position of said operating unit on a two-dim e nsional screen and the position of the virtual 
object on a two-dimensi o nal screen are synchr o nized . 
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